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Art Unit: 2176 

DETAILED ACTION 

1 . This action is responsive to the amendment filed 03/01/2007 to the original 
appHcation filed 12/20/1999. 

Claims 83-104 are currently pending in this application. Claims 1-82 have been canceled. 
Claims 83, 92, and 101 are independent claims. 

Double Patenting 



2. The nonstatutory double patenting rejection is based on a judicially created doctrine 
grounded in public policy (a policy reflected in the statute) so as to prevent the 
unjustified or improper timewise extension of the "right to exclude" granted by a 
patent and to prevent possible harassment by multiple assignees. See In re Goodman, 
1 1 F.3d 1046, 29 USPQ2d 2010 (Fed. CIT. 1993); In re Longi, 759 F.2d 887, 225 
USPQ 645 (Fed. Cir. 1985); In re van Omum, 686 F.2d 937, 214 USPQ 761 (CCPA 
1982); In re Uogel, 422 F.2d 438, 164 USPQ 619 (CCPA 1970); and In re Thorington, 
418 F.2d 528, 1.63 USPQ 644 (CCPA 1969). 

A timely filed terminal disclaimer in compliance with 37 C.F.R. ' 1.321(b) would 
overcome an actual or provisional rejection on this ground provided the conflicting 
application or patent is shown to be commonly owned with this application. See 37 
C.F.R. • 1.78(d). 
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Art Unit: 2176 

Effective January 1, 1994, a registered attorney or agent of record may sign a terminal 
disclaimer. A terminal disclaimer signed by the assignee must fully comply with 37 
CFR 3.73(b). 



(a) Claims 83-104 are provisionally rejected on the ground of nonstatutory 
obviousness-type double patenting as being unpatentable over claims 37-66 of 
copending application 10/733,981 (see claims 37-66 as submitted in the amendment 
filed 03/14/2006). Although the conflicting claims are not identical, they are not 
patentably distinct from each other because claim 83 of the instant application and 
claim 37 of copending application 10/733,981 both claim a data processing apparatus 
for processing media content comprised of a plurality of scenes, the apparatus 
comprising, an input unit operable to input content description data including: a 
plurality of importance attributes each associated with one of the segments and having 
a value representing a degree of contextual importance of the corresponding one of the 
segments; and an output unit operable to output at least one of the segments based on 
at least one of the importance attributes. The difference between claim 83 of the 
instant application and claim 37 of copending Application No. 10/733,981 is claim 83 
of the instant application further claims the important attributes having a value 
representing a degree of contextual importance of the corresponding one of the 
plurality of segments and claim 37 of copending Application No. 10/733,981 claims a 
context attribute having value for describing a context of the media content. The 
difference would have been obvious to a person of ordinary skill in the art at the time 
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the invention was made since the claim Hmitations appear to have been reworded, 
however, the scope of the invention appears to be generally the same. 

This is a provisional obviousness-type double patenting rejection because the conflicting 
claims have not in fact been patented. 

(b) Claims 83-104 are rejected on the ground of nonstatutory obviousness-type 
double patenting as being unpatentable over claims 1-13 of copending application 
09/785, 063, now U.S. Patent No. 7, 134, 074. Although the conflicting claims are 
not identical, they are not patentably distinct from each other because claim 83 of the 
instant application and claim If copending Patent No. 7, 134, 074 both claim a data 
processing apparatus for processing media content comprised of a plurality of scenes, 
the apparatus comprising, an input unit operable to input content description data 
including: a context attribute having a value for describing a context of the media 
content, a plurality of importance attributes each associated with one of the segments 
and having a value representing a degree of contextual importance of the 
corresponding one of the segments; and an output unit operable to output at least one 
of the segments based on at least one of the importance attributes. Furthermore, the 
differences between claim 83 of the instant application and claim 1 of Patent No. 7, 
134, 074 would have been obvious to a person of ordinary skill in the art at the time 
the invention was made, since claim 83 of the instant application represents the 
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invention in broader scope. The claim limitations appear to have been reworded, 
however, the scope of the invention appears to be generally the same. 



Claim Rejections - 35 USC § 103 



3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which the subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

This application currently names Joint inventors. In considering patentability of the claims under 35 U.S.C. 103(a), 
the examiner presumes that the subject matter of the various claims was commonly owned at the time any inventions 
covered therein were made absent any evidence to the contrary. Applicant is advised of the obligation under 37 
CFR 1.56 to point out the inventor and invention dates of each claim that was not commonly owned at the time a later 
invention was made in order for the examiner to consider the applicability of 35 U.S.C. 103(c) and potential 35 
U.S.C. 102(e), (0 or (g) prior art under 35 U.S.C. 103(a). 



Claims 83-84, 86-93, and 95-100 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Smith et aL ''Video Skimming and Characterization through the 
Combination of Image and Language Understanding Techniques*', June 1997, pp. 775- 
781. 



As to claims 83 and 92; 

Smith teaches a data processing apparatus and method for processing media content (e.g., 
video) comprised of a plurality of scenes (e.g., video sequences are separated into 
scenes) [see the discussion beginning at section 2, p. 776]^ the apparatus comprising: 
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• an input unit operable to input content description data (e,g,, text in the video 
provides significant information as to content of a scene) including a plurality of 
segments (e,g., segments) each for describing one of the plurality of scenes of 
media content (e.g., a scene will often contain recognizable humans, as well as 
captioned text to describe the scene), the content description data also including a 
plurality of importance attributes each associated with a corresponding one of the 
plurality of segments (e.g., identifying the most significant words in a given 
scene.., detection of objects of importance) [see pp. 776-779; see also, Fig.6, 

p. 780] ; and 

• an output unit operable to output at least one of the segments based on at least one 
of the importance attributes (e.g., extract the significant audio and video 
information and create a ''skim video which represents a very short synopsis of 
the original/display only the video pertaining to a segment s content ... The 
amount of content displayed should be adjustable so the user can view as much or 
as little video as needed, from extremely compact to full-length video) [see the 
Abstract; section LI; see also, Fig. 7, p. 781). 

Smith, does not specifically teach "a value representing a degree of contextual 
importance". However, Smith's teaching ''with prioritized video frames from each 
scene, we now have a suitable representation for combining the image and audio skims 
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for the final skim " (see section 3.3) would suggest the claimed "a value representing a 
degree of contextual importance." 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
was made to include Smith's teaching for "a value representing a degree of contextual 
importance " because it would have provided the capability for identifying the most 
significant segments in a video and effectively browsing the segments in a short time 
without losing the content of the video. 

As to claims 84 and 93: 

Smith teaches the content description data further includes a plurality of time attributes 
each associated with one of the plurality of segments for determining a start time and one 
of an end time and a duration of the one of the plurality of segments in relation to the 
media content (see section 3 J). 

As to claims 86 and 96: 

Smith teaches the content description data includes supplemental information (e.g,, the 
amount of content displayed should be adjustable so the user can view as much or as 
little video as needed; see section LI), 
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As to claims 87 and 96: 

Smith teaches the media content corresponds to video data and/or audio data (e,g,, video 
information as well as audio information; see Abstract & section LI). 

As to claims 88 and 97: 

Smith teaches each of the plurality of segments is provided with linkage information for 
linking to dominant data that represents the segment (see Abstract). 

As to claims 89 and 98: 

Smith teaches the dominant data is one or more of text data, image data and audio data 
(e.g., the audio portion; section 1.1 & audio and images embedded within the video; 
section L2). 

As to claims 90 and 99: 

Smith teaches the context description data is previously generated outside of the data 
processing apparatus prior the inputting (see section 2.2). 

As to claims 91 and 100: 

Smith teaches the ou^ut unit is operable to output in response to a user query regarding 
the context (e.g., the relevant portions of video for the segments related to their query; 
section 1.1). 
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4. Claims 85 and 94 are rejected under 35 U.S.C. 103(a) as being unpatentable over Smith 
et al. in view of Yeo et al. (U.S. 5,821,945 - issued 10/13/1998). 

As to claims 85 and 94: 

Smith does not specifically teach ''the plurality of segments are hierarchically 
described,'''' 

Yeo teaches the pluraUty of segments are hierarchically described (e.g,, a hierarchical 
view of the video provides an effective means for browsing the video content, since long 
sequences of related shots can be telescoped into a small number of key frames which 
represent the repeatedly appearing shots in the scene; col, 2, lines 35-48), 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine the teachings of Yeo and Smith because Yeo's teaching would 
have allowed users to recognize the underlying story structure and navigate to the desired 
point in the video. 
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Indication of Allowable Subject Matter 

5. Claims 101-104 appear to be allowable over the prior art of record, subject to the 
obviousness-type double patenting rejection detailed above, and subject to a final search. 

Response to Arguments 

6. Applicants' arguments filed 03/01/2007 have been fully considered but they are not 
persuasive. 

A. Regarding the nonobviousness-tvpe double patenting rejections 

(i) The nonstatutory obviousness-type double patenting rejection (a) 

MPEP §804(I)(B). 

The **provisionaV* double patenting rejection should continue to be made by the 
examiner in each application as Ions as there are conflicting claims in more than 
one application unless that ^'provisional" double patenting rejection is the only 
rejection remainins in one of the applications. If the "provisional" double 
patenting rejection in one application is the only rejection remaining in that 
application, the examiner should then withdraw that rejection and permit the 
application to issue as a patent, thereby converting the "provisional" double 
patenting rejection in the other application(s) into a double patenting rejection at 
the time the one application issues as a patent, 

(ii) The nonstatutory obviousness-type double patenting rejection (b) 

hi the Office Action, the examiner did show what are claimed in both cases. 
Additionally, the Examiner states " The differences between claim 83 of the 
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instant application and claim 1 of Patent No. 7, 134, 074 would have been 
obvious to a person of ordinary skill in the art at the time the invention was made, 
since claim 83 of the instant application represents the invention in broader 
scope". Therefore, the examiner believes that the rejection is proper. 

B. Regarding the 35 USC § 103 rejections 

Applicant argues in substance that Smith does not teach "data processing apparatus" 
[Remarks, page 5]. 

In response, Smith teaches, inter alia, browsing", '^displaying" (pdige 775). There must 
be an apparatus providing means for ''browsing" and means for "displaying". At page 
775, Smith discloses ''browser would display only the video pertaining to a segment s 
content, suppressing irrelevant data ,,,the user can view as much or as little video as 
needed". Smith's browser can not display if it is not in an apparatus. 

Applicant argues in substance that Smith does not teaches input unit operable to input 
content description data [Remarks, page 5]. 

The examiner's response is as follows. Firstly, in the Office Action, the examiner 
mapped each claimed limitation to specific element(s) and/or relevant passages in the 
Smith reference to show how the reference meets the claim limitations. Applicant in 
response did not provide any underlying analysis as to why the portions of the prior art 
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relied on did not support the examiner's position. Secondly, Smith teaches input unit 
operable to input content description data (e.g., browser would display only the video 
pertaining to a segment 5 content, suppressing irrelevant data ...the user can view as 
much or as little video as needed ...simply using the synchronized portion corresponding 
to the selected video frames ...choosing the significant image and words *' that should be 
included in the skim video; see page 775, beginning the 

Applicant further argues in substance that Smith does not teach an "importance attribute" 
that has a "value representing a degree of contextual importance of said corresponding 
one of said plurality of segments". 

In response. Smith's system must assign "values" when "prioritizing" to indicate 
high/low level of priority (see page 779) [Remarks, page 6]. 

Finally, Applicant argues that the Examiner has not provided the proper motivation or 
rationale for modifying the base reference [Remarks, page 7]. 

In response. Examiner notes that the test for the relevance of a cited combination of 
references is: "whether the teachings of the prior art, taken as a whole, would have made 
obvious the claimed invention," In re Gorman, 933 F.2d at 986, 18 USPQ2d at 1888. 
Subject matter is unpatentable under section 103 if it would have been obvious ... to a 
person having ordinary skill in the art. While there must be some teaching, reason, 
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suggestion, or motivation to combine existing elements to produce the claimed device, it 
is not necessary that the cited references or prior art specifically suggest making the 
combination: In reNilssen, 851 F.2d 1401, 1403, 7 USPQ2d 1500, 1502 (Fed. Cir. 
1988)." Such suggestion or motivation to combine prior art teachings can derive solely 
from the existence of a teaching, which one of ordinary skill in the art would be 
presumed to know, and the use of that teaching to solve the same [or] similar problem 
which it addresses. In re Wood, 599 F.2d 1032, 1037, 202 USPQ 171, 174 (CCPA 1979). 
"In sum, it is off the mark for litigants to argue, as many do, that an invention cannot be 
held to have been obvious unless a suggestion to combine prior art teachings is foimd in a 
specific reference." In re Oetiker, 24 USPQ2d 1443 (CAFC 1992). 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS fi*om the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated fi"om the mailing date of the 
advisory action. In no event, however, will the statutory period for reply expire later than 
SIX MONTHS fi'om the mailing date of this final action. 
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Contact information 



Any inquiry concerning this communication or earlier communications from the 



examiner should be directed to Maikhanh Nguyen whose telephone number is (571) 272- 
4093. The examiner can normally be reached on Monday - Friday from 9:00am - 5:30 
pm. If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather Hemdon can be reached at (571) 272-4136. 

The fax phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 

Any response to this action should be mailed to: 

Commissioner for patents 
POBox 1450 

Alexandria, VA 22313-1450 
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